Unimodal regularisation based on beta distribution for deep ordinal regression
نویسندگان
چکیده
Currently, the use of deep learning for solving ordinal classification problems, where categories follow a natural order, has not received much attention. In this paper, we propose an unimodal regularisation based on beta distribution applied to cross-entropy loss. This encourages labels be soft distribution, more appropriate problems. Given that two parameters must adjusted, method automatically determine them is proposed. The regularised loss function used train neural network model with scheme in output layer. results obtained are statistically analysed and show combination these methods increases performance Moreover, proposed performs better than other distributions previous works, achieving also reduced computational cost.
منابع مشابه
Unimodal Probability Distributions for Deep Ordinal Classification
Probability distributions produced by the crossentropy loss for ordinal classification problems can possess undesired properties. We propose a straightforward technique to constrain discrete ordinal probability distributions to be unimodal via the use of the Poisson and binomial probability distributions. We evaluate this approach in the context of deep learning on two large ordinal image datas...
متن کاملDeep Ordinal Regression Based on Data Relationship for Small Datasets
Ordinal regression aims to classify instances into ordinal categories. As with other supervised learning problems, learning an effective deep ordinal model from a small dataset is challenging. This paper proposes a new approach which transforms the ordinal regression problem to binary classification problems and uses triplets with instances from different categories to train deep neural network...
متن کاملOrdinal regression based on learning vector quantization
Recently, ordinal regression, which predicts categories of ordinal scale, has received considerable attention. In this paper, we propose a new approach to solve ordinal regression problems within the learning vector quantization framework. It extends the previous approach termed ordinal generalized matrix learning vector quantization with a more suitable and natural cost function, leading to mo...
متن کاملOptimal Algorithms for Unimodal Regression
This paper gives optimal algorithms for determining realvalued univariate unimodal regressions, that is, for determining the optimal regression which is increasing and then decreasing. Such regressions arise in a wide variety of applications. They are a form of shape-constrained nonparametric regression, closely related to isotonic regression. For the L2 metric our algorithm requires only (n) t...
متن کاملMOrdReD: Memory-based Ordinal Regression Deep Neural Networks for Time Series Forecasting
Time series forecasting is ubiquitous in the modern world. Applications range from health care to astronomy, include climate modelling, financial trading and monitoring of critical engineering equipment. To offer value over this range of activities we must have models that not only provide accurate forecasts but that also quantify and adjust their uncertainty over time. Furthermore, such models...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition
سال: 2022
ISSN: ['1873-5142', '0031-3203']
DOI: https://doi.org/10.1016/j.patcog.2021.108310